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A Characterization of a New Type of Strong Law of Large Numbers 
Deli lQ • Yongcheng qO- Andrew RosalskjH 



Abstract Let < p < 2 and 1 < g < oo. Let n > 1} be a sequence of independent copies of a 

real- valued random variable X and set = Xi + ■ ■ ■ + X„, n > 1. We say X satisfies the (p, q)-type 

strong law of large numbers (and write X G SLLN{p,q)) if ^J!)^! ^ (j?7p) ^ °° almost surely. This 
paper is devoted to a characterization of X E SLLN{p,q). By applying results obtained from the 
new versions of the classical Levy, Ottaviani, and Hoffmann-j0rgensen (1974) inequalities proved by Li 
and Rosalsky (2013) and by using techniques developed by Hechner and Heinkel (2010), we show that 
X e SLLN{p, q) if and only if 



EX = and / P^/^ (|X|'? > t) dt < oo 
Jo 

°° r. . p iip(ix|p > t)dt 

EX = 0, E Xp' < OO, and > ^ ^ 

^ n 

n=l 

EX = and E|X[p < oo 

^ |EX/||X| < n| I 

EX = 0, > ^' ' ~ ^ ' < oo, and 

^-^ n 

n=l 

£inM^i\^\>t)dt 



if 1 < q < p < 2, 

<oo if 1 < p = q < 2, 

if 1 < p < 2 and q > p, 



E 

n=l 



< oo 



n 



, ^ lEX/ilXl < n}|^ 
EX = and > ^ ^' ' " ^' < 



oo 



n=l 



EIXP < oo 



if q=p=l^ 



if p = 1 < 



if < p < 1 < g, 



where n„ = inf |t : ]P(|X[ > t) < ;i} , n > 1. For q = 1, this equivalence has recently been discovered 
by Li, Qi, and Rosalsky (2011). Versions of above results in a Banach space setting are also presented. 
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1 Introduction 



Throughout, let (B, j| • |[) be a real separable Banach space equipped with its Borcl cr-algebra B (= 
the (T-algebra generated by the class of open subsets of B determined by || • ||) and let {X^, n > 1} 
be a sequence of independent copies of a B-valued random variable X defined on a probability space 
(fi, J", P). As usual, let Sn = Ylk=i -^k, n > 1 denote their partial sums. If < p < 2 and if X is a 
real- valued random variable (that is, if B = M), then 



lim —rj- = almost surely (a.s.) 

n— ^-oo Ti 



if and only if 



E|X|^ < oo where EX = whenever p > 1. 



This is the celebrated Kolmogorov-Marcinkiewicz-Zygmund strong law of large numbers (SLLN); see 
Kolmogoroff [8] for p = 1 and Marcinkiewicz and Zygmund [13] for p 1. 

The classical Kolmogorov SLLN in real separable Banach spaces was established by Mourier [17]. 
The extension of the Kolmogorov-Marcinkiewicz-Zygmund SLLN to B-valued random variables is in- 
dependently due to Azlarov and Volodin [1] and de Acosta [3]. 

Theorem 1.1. (Azlarov and Volodin [1] and dc Acosta [3]). Let < p < 2 and let {X^; n > 1} be a 
sequence of independent copies of a B-valued random variable X. Then 



lim 

n— >oo fi 



1/p 



= a.s. 



if and only if 



E||Xf < oo and 



Sn 



n 



i/p 



0. 



Let {Rn\ n > 1} be a Rademacher sequence; that is, {i?, 
and identically distributed (i.i.d.) random variables with P {R 
B X B X B X • • • and define 



n > 1} is a sequence of independent 
= 1) = F{Ri = -1) = 1/2. Let B~ = 



C{B) = \{vuV2,...)eB^ : Y^RnV n converges in probability > . 

I n=l J 



Let 1 < p < 2. Then B is said to be of Rademacher type p if there exists a constant < C < oo such 
that 

oo 

E y^-Rnt^n 
n=l 

Hoffmann-j0rgensen and Pisier [7] proved for 1 < p < 2 that B is of Rademacher type p if and only if 
there exists a constant < C < oo such that 



P oo 

<C^||u„||^ for all (i;i,'U2, 

n=l 



gC(B) 



E 



k=l 



k=l 



for every finite collection {Vi, V^} of independent mean B-valued random variables. 

If B is of Rademacher type p for some p G (1, 2], then it is of Rademacher type q for all q G [l,p). 
Every real separable Banach spaces is of Rademacher type (at least) 1. 

Let < p < 2 and let {Qn', n > 1} be a sequence of i.i.d. stable random variables each with 
characteristic function tp{t) = e^p{—\t\P}, — oo < i < oo. Then B is said to be of stable type 
P if ©n^n converges a.s. whenever {vn '■ n > 1} C B with X^^i jjt'nll^ < oo. Equivalent 
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characterizations of a Banach space being of stable type p, properties of stable type p Banacli spaces, 
as well as various relationships between the conditions "Rademacher type p" and "stable type p" may 
be found in Maurey and Pisier [16], Woyczyhski [20], Marcus and Woyczyhski [15], Rosihski [19], Pisier 
[18], and Lcdoux and Talagrand [9]. Some of these properties and relationships are summarized in Li, 

Qi, and Rosalsky [10]. 

De Acosta [3] also provided a remarkable characterization of Rademacher type p Banach spaces. 
Specifically, de Acosta [3] proved the following theorem. 

Theorem 1.2. (de Acosta [3]). Let 1 < p < 2. Then the following two statements are equivalent: 

(i) The Banach space B is of Rademacher type p. 

(ii) For every sequence {X^, n> 1} of independent copies of a ^-valued variable X, 

S 

lim — ^ = a.s. if and only if E\\X\\p < oo and EX = 0. 

At the origin of the current investigation are the following recent and striking result by Hechner 
and Heinkel [5] which is new even in the case where the Banach space B is the real line. The earliest 

investigation that we are aware of concerning the convergence of the series X^^i ^ was carried 

out by Hechner [4] for the case where n > 1} is a sequence of i.i.d. mean real-valued random 

variables. 

Theorem 1.3. (Hechner and Hcinkcl [5]). Suppose that B is of stable type p (\ < p < 2) and let 
{Xn\ n>l} be a sequence of independent copies of a ^-valued variable X with EX = 0. Then 

1 f n\Sn\\ \ 

n=l ^ ' 

if and only if 

POO 

/ pi/p(||x|| > t)dt < oo. 
Jo 

Inspired by the above discovery by Hechner and Heinkel [5], Li, Qi, and Rosalsky [10] obtained sets 
of necessary and sufficient conditions for 




for the three cases: 0<p<l, p = l,l<p<2. Moreover, Li, Qi, and Rosalsky [10] obtained necessary 
and sufficient conditions for 




Again, these results are new when B = M; see Theorem 2.5 of Li, Qi, and Rosalsky [10]. 

Motivated by the results obtained by Li, Qi, and Rosalsky [10], we introduce a new type strong law 
of large numbers as follows. 

Definition 1.1. Let < p < 2 and < q < oo. Let {X^, n > 1} be a sequence of independent copies 
of a ^-valued random variable X. We say X satisfies the {p,q)-type strong law of large numbers (and 
write X e SLLN{p,q)) if 
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The following result was recently obtained by Li, Qi, and Rosalsky [11] who proved it by employing 
new versions of the classical Levy, Ottaviani, and Hoffmann-j0rgensen [6] inequalities established by Li 
and Rosalsky [12] and by using some of techniques developed by Hechner and Heinkel [5]. Note that 
no conditions are imposed on the Banach space B. Theorem 1.4 will be used in the proofs of the main 

results of the current work. 

Theorem 1.4. Let < p < 2 and < q < oo. Let n > 1} be a sequence of independent copies of 

a ^-valued random variable X. Then 



oo ^ 

n 



n=l 



Sn 



n 



i/p 



< oo 



if and only if 
and 



X e SLLN{p, q) 

[ P9/P(||X||« > < oo ifO<q<p, 
Jo 



EjjXf ln(l + ||X||) < oo ifq=p, 

^ E\\X\\i<oo ifq>p. 
Furthermore, each of (1.1) and (1-2) implies that 

Sn 



lim 



a.s. 



(1.1) 
(1.2) 



(1.3) 



For < q < p, (1-1) and (1-2) are equivalent so that each of them implies that (1.3) and (I.4) hold. 



(1.4) 



Remark 1.1. Let q = 1. Then one can easily see that Theorems 2.1 and 2.2 of Li, Qi, and Rosalsky 
[10] follow from Theorem I.4. 



Remark 1.2. It follows from the conclusion (I.4) of Theorem I.4 that, if (1.2) holds for some q = qi > 
then (1.2) holds for all q > qi. 



The current work continues the investigations by Hechner and Heinkel [5] and Li, Qi, and Rosalsky 
[10] and [11]. More specifically: 

(i) For < p < 1 and p < q < 00 and without any conditions being imposed on the Banach space B 

we obtain in Theorem 2.1 necessary and sufficient conditions for X G SLLN{p,q). 

(ii) For 1 < < 00 we obtain assuming the Banach space B is of stable type p where 1 < p < 2 
(Theorem 2.2) ov p = 1 (Theorem 2.3) necessary and sufficient conditions for X G SLLN{p,q). 

Theorems 1.4, 2.1, 2.2, and 2.3 are new results when B = M (Theorem 2.4). 

When B = R, necessary and sufficient conditions for X G SLLN{p, q) for the case where < g < 
1 < p < 2 and for the case where Q < q < p < 1 remain open problems. 

The plan of the paper is as follows. The main results are stated in Section 2 and they are proved 
in Section 3. In Section 4, three examples will be provided for illustrating the necessary and sufficient 
conditions obtained in this paper. 
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2 Statement of the main results 



With the prehminaries accounted for, the main results may be stated. 

Theorem 2.1. Let < p < 1 and p < q < oo. Let n > 1} be a sequence of independent copies of 

a ^-valued random variable X. Then we have the following two statements: 



(a) X e SLLN{p,q) if and only ifE\\X\\P < oo, 

°° 1 / 115" II \ 

(b) V -E <oo if and only i/EllXf < oo. 
^ n \ n'-'P I 

n=l ^ ' 



Let X be a B- valued random variable. For each n > 1, we define the quantile Un of order 1 — of 
||X|| as follows: 

Un=m{lt: F{\\X\\ < t) > 1 - ^\ = inf It : F{\\X\\ > t) < ^\ . 



If < oo, then it is easy to show that 



lim — = 0. 



Theorem 2.2. Let 1 < p < 2 and 1 < q < oo. Let ^ be a Banach space of stable type p. Let 
{Xn, n > 1} be a sequence of independent copies of a ^-valued random variable X. Then 



X G SLLN{p,q) 



(2.1) 



if and only if 



( EX = and 



roo 

oo 

Jo 



ifl<q<p, 



^ T- s p {\\x\\p > t) dt 

E A r < OO and > < oo if q = p, 



n=l 



EIIXIP < oo 



ifq>p. 



(2.2) 



Remark 2.1. When q = 1 and B is of stable p where 1 < p < 2, Corollary 2.1 of Li, Qi, and Rosalsky 
[10] follows immediately from Theorems 1.4 and 2.2; that is, (1.1), (1.2), and (2.2) are equivalent. 

Note by Lemma 5.6 of Li, Qi, and Rosalsky [10] that 

P- / p x^{\\X\\P > t)dt 
j2 J^^n{u„,ni n whenever E||X||p ln''(l + ||X||) < oo for some S > 0. 

n=l 



Thus, for the interesting case q = p, Theorem 2.2 yields the following result. 
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Corollary 2.1. Let 1 < p < 2 and let {Xn, n > 1} be a sequence of independent copies of a ^-valued 
random variable X. IfB is of stable type p, then 

X e SLLN{p,p) whenever EX = and E||Xf ln''(l + < oo for some 6 > 0. 



For the case where 1 < p < 2 and 1 < g < oo, combining Theorems 1.4 and 2.2, we immediately 
obtain necessary and sufficient conditions for (1.1) to hold assuming that B is of stable type p. 

Corollary 2.2. Let 1 < p <2 and 1 < q < oo. Let X be a ^-valued random variable. //B is of stable 
type p, then (1-1) holds if and only if 

f EX = and 

' poo 

/ F'ilP {\\X\\i >t)dt< oo if\<q<p, 
Jo 

E||X||fln(l + ||X||) <oo ifq = p, 
[ E||Xr <oo ifq>p. 



Remark 2.2. For the case where q = 1, Corollary 2.2 above is Theorem 1.3 (i.e., Theorem 5 of Hechner 
and Heinkel [5]). Actually Corollary 2.2 for the case where q = 1 is somewhat stronger than Theorem 5 
(necessity half) of Hechner and Heinkel [5] because EX = is an assumption in Theorem 5 of Hechner 
and Heinkel [5]. 



We now present necessary and sufficient conditions for (1.2) for the case where p = 1 and 1 < q < oo. 

Theorem 2.3. Let 1 < g < oo and let 'B be a Banach space of stable type 1. Let {X„; n > 1} be a 
sequence of independent copies of a B-valued random variable X. Then 



X G SLLN{l,q) 



if and only if 

' E||X|| < oo, EX = 0, and 



^ ||EXJ{||X||<n}|| ^ , ^ J:inW,n}^(ll^ll>^)^^ . , 
> < oo and > < oo if q = \, 



n=l 

oo 

E 

^ n=l 



n=l 



n 



||EX/{||X|| < n] 



< oo 



n 



ifq>\. 



(2.3) 



(2.4) 



Remark 2.3. For the case where q = \, Theorem 2.3 is Theorem 2.3 of Li, Qi, and Rosalsky [10]. 



By Lemmas 5.5 and 5.6 of Li, Qi, and Rosalsky [10], (2.4) holds whenever EX = and E||X|| ln(l + 
||X||) < oo. Combining Theorems 1.4 and 2.3, we immediately have the following result. 
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Corollary 2.3. Let 1 < q < oo and let B be a Banach space of stable type 1. Let {Xn] n > 1} be a 
sequence of independent copies of a ^-valued random variable X. Then 



oo -. 

n 



n=l 



I Q 



n 



< oo 



if and only if 



( EX = and 

{ E||X||ln(l+||X||) <oo ifq=l, 
E||Xp<oo ifq>l. 



As a summary of our Theorems 1.4 and 2.1-2.3 and Corollaries 2.2 and 2.3, we now present the 
following theorem for a real- valued random variable X. For q = 1, the equivalence of (i) and (ii) has 
recently been obtained by Li, Qi, and Rosalsky [10], and for 1 = q < p < 2, the equivalence of (iii) 
and (iv) is due to Hechner and Heinkel [5] (see Theorem 1.3 above) assuming that EX = for the 
implication ((iii) =^ (iv)). 

Theorem 2.4. Let < p < 2 and 1 <q < oo. Let {Xn, n>\) be a sequence of independent copies of 
a real-valued random variable X. The following two statements are equivalent: 



(i) X^SLLN{p,q), 



EX = and 



(ii) 



(|X|« >t)dt<oo 



EX = 0, E\X\P < oo, and ^ 



'{\X\P > t)dt 



n=l 



n 



EX = and ElXP < oo 



^\EXI{\X\<n} , 
EX = 0, 2^ _^ < oo, and 



ifl<q<p<2, 

<oo if l< q = p < 2, 

if 1 < p < 2 and q > p, 



n=l 



n 



~ p. r ^P(|X| > t)dt 

v-^ Jimn{u„,n} VI I ^ / 

> < oo 



n=l 



, ^ \EXI{\X\ < n}\ 
EX = and > ^' ' " 

n=l 

^ E\X\P < oo 
The following two statements are equivalent: 

\'Jn\ \ 



< oo 



if Q = P='^, 

ifp = l< q, 
ifO<p<l<q. 



n=l ^ ' 



< oo. 
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(iv) < 



EX = and / F'^/p >t)dt<oo ifl<q<p<2, 
Jo 



EX = and E|X|*' ln(l + < oo 
EX = and E\X\p < oo 
^ ElXl'' < oo 

3 Proofs of Theorems 2.1-2.3 



if l<q=p<2, 

if ^ < P < ^ and q > p, 

if Q < p < I < q. 



In this section we denote by Ck positive constants the precise values of which do not matter. 

First we introduce some notation. Let (afc)i<fc<„ be a finite sequence of real numbers and (a^)i<fc<„ 
the nonincreasing rearrangement of the sequence {\ak\)i<k<n- For a given r > 1, 



yflk)l<k<n\ 



1 1/r * 
= sup / Ofe 

l<fe<n 



is called the weak-ir norm of the sequence {ak)i<k<n- Let V^, 1 < k < n he independent real-valued 
random variables. Then the remarkable Marcus-Pisier [14] inequality asserts that for all r > 1, 



(||(14)l<fe<n||,oo>^) <^SUp(rVP(|14|>i)) VtX>0. 



(3.1) 



k=l 



The original Marcus-Pisier [14] inequality involved the constant 262 instead of 2e. The improved 
constant is due to J. Zinn (see Pisier [18, Lemma 4.11]). 

Let X be a B- valued random variable. For each n > 1, let the quantile n„ of order 1 — ^ of ||X|| be 
defined as in Section 2. We then see that for every q> 0, 



iniU: 



\X\\i <t)>l- 



n 



inflt: F{\\X\\i >t)<-> = u: 



i.e., Un is the quantile of order 1 — ^ of Let n > 1} be a sequence of independent copies of 

B-valued variable X. Write, for n > 1, 

n n 

= Y,x,i{\\xuf < k}, s^) = Sn- 5W = Y^x,i{\\x,r > k}, 



k=l 



k=l 



Un = J2^kI{\\Xkr < n}, C/^') = ^ XkI{\\Xk\\ < Un}, and U^^^ = C/„ - U^'\ n > 1. 

fe=l k=l 

Motivated by Lemma 1 of Hechner and Heinkel [5] and its proof, we establish the following result. 

Lemma 3.1. Let 1 < p < 2 and 1 < q < p. Let G be a Banach space of stable type p. Then there 
exists a universal constant c{p, q) > such that, for every finite sequence Vk,l < k < n of independent 
B-valued random variables with maxi<fe<„E||14||'^ < oo, 



E 



5^ (14 - ^Vk) 



k=i 



1 / n \ llv 

<c(p,g)(supt^/^^P(||yfer >i)j . 



(3.2) 



k=\ 



Remark 3.1. Clearly, if q = 1, then Lemma 3.1 is Lemma 1 of Hechner and Heinkel [5]. 
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Proof of Lemma 3.1 Let {V^; 1 < /c < n} be an independent copy of {V^; 1 < k < n} and let 
{Rk\ 1 < A; < n} be a Rademacher sequence independent of {Vfe,V"^'; 1 < A; < n). Since g > 1, 
g{x) = x^, X G [0, oo) is a convex nonnegative function. Applying (2.5) of Ledoux and Talagrand [9, p. 
46], we have that 



k=l 



< E 



k=l 



k=l 



^RkVk 



k=l 



(3.3) 



Since B is of stable type p with 1 < p < 2, the Maurey-Pisier [16] theorem asserts that it is also of 

stable type r for some r > p. Let (^fc)i<fc<„ be the nonincrcasing rearrangement of (||V^.||)^<^,<jj. Note 
that r/q > 1, p/q > 1 (since 1 < q < p < r), and B is also of Rademacher type r. We thus have that 

q 

Rk^k 



E 



k=l 



(■( 


n 1 

"^Rk^k 

k=l 


(■( 


n »" 

Y^RkVk 

k=l 



Vl,...,Vn 



l/(r/q) 



Vi,...,v; 



< ciE^^iiv^ir 



q/r 



\k=l 



/ n 

C^E ^ [k^/P (Air) k- 



q/r 



-r/p 



\k=l 



< Cie| ( sup ki/p{Aiyj (E^^'^n 



l<fc<n 



(3.4) 



= CoE 



l<k<n 



p/q,oo 



Write A = supj>o ELi dl^fcll^ > Using the Marcus-Pisier [14] inequality (3.1), we have that 

E fr.r)i<,<n , = I / + / . ip( (ii^^r) 



p/q,oo 



= 1 + 



J Ai/p I 
°° 2eA 



l<fc<n 



p/q,oo 



>t]dt 



lA^/p tP/9 

^ 



dt 



(3.5) 



Now (3.2) follows from (3.3), (3.4), and (3.5). □ 

The following nice result is Proposition 3 of Hechner and Heinkel [5]. 

Lemma 3.2. (Hechner and Heinkel [5]). Let p > 1 and let {X^, n > 1} be a sequence of independent 
copies of a G -valued random variable X. Write 

Un = milt: P(||X|| >t) , n > 1. 
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Then the following three statements are equivalent: 

POO 

(i) / PVP(||X|| > t)dt < oo; 

^0 

oo 



n=l 

oo 



n=l ^ ' 



The next lemma and its proof are similar to Lemma 3 of Hechner and Heinkel [5] and its proof, 
respectively. 



Lemma 3.3. Let 1 < q < p < 2. Let X be a ^-valued random variable with 

roo 

/ ¥'i/P{\\XW^ >t)dt< oo. 
Jo 

If G is a Banach space of Rademacher type q, then 



(3.6) 



oo^ E II (^Sn - C/^'^) - ^[Sn- C/^'^) 



n=l 



< oo. 



(3.7) 



Proof Let fq{t) = P (||X||^ > t) , t>0. Since B is a Banach space of Rademacher type q and 

n 

(S„ - t/^i)) -E(^Sn- U(^^) = (XkHWXkW > Un} - EXI{\\X\\ > Un}) , n > 1, 



k=l 



we have that 



E 



(^Sn - U!^^') - E (5„ - U^^) IP < CgnE ||X7{||X|| > Un} - EXI{\\X\\ > Ur, 



< C4nE(||xr/{||xr ><}) 



C4{n<P(||Xr >0 + n I ' fg{t)dtj 



(3.8) 



poo 

, / fS)dt 

Jul 



Set pi = p/q, Y = ll^ll'^, and Un,q = Un, n > 1. Noting that pi > 1 (since 1 < q < p < 2), hy Lemma 
3.2 (i.e., Proposition 3 of Hechner and Heinkel [5]), it follows from (3.6) that 



oo q 
U 



'•n.q 



n=l n=l 



< OO. 



(3.9) 
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Also (3.6) implies that 



oo 

^1 n<//f A? 



oo 

n=l ^ -""r, 



n=l j=n '"■3^1 



{t)dt 



j=l y-^'j.'! ) n=l 



i-i/pi 



(3.10) 



i-i/pi 



/•oo 

Jo 

POO 

= C5 ri/p{\\x\\i >t)dt 

Jo 



< 00. 

The conclusion (3.7) follows from (3.8), (3.9), and (3.10). □ 

The proof of the next lemma is similar to that of Lemma 4 of Hechner and Heinkel [5] and Lemma 
5.3 of Li, Qi, and Rosalsky [10] and it contains a nice application of Lemma 3.1 above. 

Lemma 3.4. Let 1 < q < p < 2. Let X be a ^-valued random variable with (3.6). If 'R is a Banach 
space of stable type p, then 



00 e||c/W -EC/i^^ 

E- 

n=l 



n 



1+9/p 



< 00. 



(3.11) 



Remark 3.2. Note that 



n\xf 



\X\\'i > t)dt. 



Thus for q = p, (3.6) holds if and only «/E||X||^ < 00. By Lemma 3.4, i/B is a Banach space of stable 
type p E [1,2), then 



n=l 



< 00 



(3.12) 



whenever KWXWP < 00. 



Proof of Lemma 3.4 Since B is of stable type p, the Maurcy-Pisier [16] theorem asserts that it is also 
of stable type r for some r > p. Applying Lemma 3.1, there exists a universal constant < c(r, q) < 00 
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such that 



E 



C/«-E[/«' < c{r,q)[snpf/'^Y.^{\\Xk\\n{\\Xk\\<Un}>t) 



q/r 



t>0 



k=l 



q/r 



< c{r,q) n sup , n > 1. 

V Q<t<ul I 



It is easy to see that for ah x > 0, 

' j\<ii^ {\\xf >t)dt^''^ > {wxwi >x)dt 



r/q 



We thus have that 



E 



x^/«P(||X||« >x) 



C/W-EC/W ^ < c(r,g)(n sup f/^P (||X||« > t) 



q/r 



< c(r, g)n«/'' T" P"/'' > t) dt, n > 1. 

JO 

Let uo = and note that P(||X||9 > t) > l/k for t G [ul_i,ul), A; > 1. It follows that 



E 

n=l 



< c(r. 



1 

n=l 

n=l fc=l"^"fe-i 



oo / oo 



1 



fc=l \n=fe 



n^+q/p-q/r 



fc=i " "fc-i 



/•oo 

Ce / P«/^'(||Xp>t)dt<oo 

JO 



proving (3.11) and completing the proof of Lemma 3.4. □ 

Lemma 3.5. Let 1 <p <2 and let X he a ^-valued random variable with E||X||*' < oo. Then 



oo . / n \ P 

n=l \jk=l / 



(3.13) 
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OO p 



and for every (5 > 0, 



n=l 



^WWl^^, ,,,, 



n=l 



Furthermore, if p > 1 then 



fWiPM!,^. (3.16) 

n=l 



Remark 3.3. Forp = 1, (3.13) and (3.14) together are Lemma 5.1 of Li, Qi, and Rosalsky [10]. 

Proof of Lemma 3.5 Since Un is the quantile of order 1 — ^ of H^p, (3.14) immediately follows 
from the second half of Lemma 5.1 of Li, Qi, and Rosalsky [10]. 
The proof of (3.15) is easy and we leave it to the reader. 
We now show that ^\X\\P < oo implies (3.13). For n>2, let 



An = ^kF{k-l<\\X\\P <k), \n,j = ^^^^ l<ll^r<j) ^ 2<j<n. 

k=2 ^" 

Clearly 

n 

K,j > 0, 2 < j < ra, ^ Xnj = 1, 

3=2 

and 

A„ <E||Xf + 1< oo, n>2. 
Note that the function (f){t) = t^ is convex on [0, oo) and 

n n n 

||X||^7{A:<||Xr <n} = \\X\\I {j - 1< \\Xr < j} 

k=l k=l j=k+l 



n n 



k=lj=k+\ 
n j-l 

j=2 k=l 
n 

< J]/+Vf7{j-l<||xr<i}, n>2. 

J=2 
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We thus have that 

(^E\\X\\I{k < \\Xr < n}^ = ^ (^\X\\pHk < \\Xr < n}j j 

< (e( J]/+Vf/{j--l<||xr<j}'^ 

= ( J]/+^/^'P(i-l<||X||f <j)^ 



= Ar^f^i'p(i-i<iixr<j) 



J=2 



< C7^j¥(j-1< llXf <i), n>2. 

j=2 



It now is easy to see that 



oo^n oo/oo^\ 
n=l j=2 j=2 \n=j / 



< C8^jp(i-i<iixr<i) 

j=2 

< C8(E||X||f + 1) <oo 



thereby proving (3.13). 

We now prove (3.16). Note that for n > 1, 



E||X||/{||X||f >n} < ^ iVPp(j-_i<||xf <i) 

j=n+l 
oo 

= E //^-'(jF(j-l<||X||^'<j)) 

j=n+l 

and 

oo 

^jp(j-i<iixr<j)<Eiix||f + i. 
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Thus, by the same arguments used in proving (3.13), we have that 

oo 

(E||X||/ {||X||^' > n}f < CgJ2j''' (i - 1< ll^ll'' < j)) ^ ri>l. 



j=n 



Since p > 1, we get that 

-'(EiiA-|,{iixr>^ . c,f;-i,f;i-uPa-:<iixr,,), 



n=l 



n 



2-p 



n=l j=n 



j=l \n=l J 



< Cio(E||X||f + 1) <oo 



proving (3.16). □ 



The following recent result of Li, Qi, and Rosalsky [11] is used in the proof of Theorem 2.3. It 
was proved by applying the new versions of the classical Levy and classical Hoffmann-j0rgensen [6] 
inequalities established by Li and Rosalsky [12]. 

Theorem 3.1. (Li, Qi, and Rosalsky [11]). Let q > and let {an] n>l} be a sequence of nonnegative 
real numbers such that J^^i On < co. Let {V^; k >!} be a sequence of independent symmetric ^-valued 
random variables. Write 



6„ = ^ afc, ra > 1 



k=n 



and 



a 



2^-1, if 0<q<l 



1, if q> 1. 



1, if 0<q<l 



and P 



2i-\ if q>l. 



Then, for all nonnegative real numbers s, t, and u, we have that 



(^sup6„ \\Vnf > < 2P [^an 



i=l 



> 



a 



and 



P E"fe 



Kn=l 



1=1 



> S + t + U 



< P (^snpbn \\Vnf > -^j + 4P (^^an 



1=1 



> 



u 

af5 



K.n=l 



E^^ 
1=1 



> 



Furthermore, we have that 



E 



(^sup6n||Fnf) <2aE 



ak 



i=l 
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and 



where 



(CX) 
n=l 



i=l 



< 6(a + pfE ( supbn \\Vnf ) + 6(a + pfto, 

\n>l 



to = milt>0; P ( X] ' 



Vn=l 



i=l 



>t] < 2i-\a + py 



Lemma 3.6. (Li, Qi, and Rosalsky [11]). Let (E, ^) be a measurable linear space and g : E ^ [0, oo] 
be a measurable even function such that for all x, y G E, 

5(x + y) < /9 (<7(x) + <7(y)) , 

where 1 < f3 < oo is a constant, depending only on the function g. IfW is an E-valued random variable 
and Y is a symmetrized version ofY (i.e., Y = Y — V where V is an independent copy of\), then 
for all t >0, we have that 

P(5(V) < t)Eg{V) < pEg{-V) + pt 

and 

Eg{y) < 2^E5(V). 

Moreover, if 

5(V) < oo a.s., 

then 

Eg^V) < oo if and only if Eg{\') < oo. 



Lemma 3.7. Let 1 < p < 2 and let {X^, n > 1} be a sequence of independent copies of a G-valued 
random variable X with EX = and E||X||*' < oo. //B is a Banach space of Rademacher type p, then 



oo ^ 

y-E 



n=l 

Proof Note that 



n 



^ f , I f ^^^( \\Un-^Unr \ ^ 

< OO if and only if > — t ) < oo. 

^-^ n \ n 

n=l ^ 



(3.17) 



n 

(^5^ - E^W^ - (Un - EUn) = {Xkl{k < \\XkY <n)- EXI{k < ||Xf < n}) , n>l. 



k=l 



Then since B is a Banach space of Rademacher type p, we have that 



E 



n 

(sW-ESW) _(C/^_EC/„)|r < Cii^E||X/{A: < \\X\\p <n} -EXI{k < \\X\\p <n}f 



< Ci2 E||X||^'/{A: < \\X\\P <n}, n> 1. 



k=i 



Let Y = \\X\\P. Then it foUows from EY < oo (since E||Xp < oo) and the first conclusion of Lemma 
3.5 (i.e., (3.13)) that 

~ 1 / (si'^-ES^r^A-{Un-EUn) '\ ^ 1 " 

^-E ^ ^- ]<C\2j2^E^Ynk<Y<n}<oo, 

n=l \ J n=l fe=l 
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which yields (3.17). □ 

Proof of Theorem 2.1 To prove Theorem 2.1, we make the fohowing simple observation. Let < 
p < q <1. Let {Xn', n > 1} be a sequence of independent copies of a B-valued random variable X with 
mX\\P < oo. Set pi = p/q, Y = \\X\\i, = n > 1. Then < pi < 1 and EF^i < oo, and 



n=l ^ ^ n=l k=l \n=k / k=l 



< OO a.s. 



(see Theorem 5.1.3 in Chow and Teicher [2, p. 118]). Theorem 2.1 follows immediately from this 
observation together with Theorem 1.4 and Remark 1.2. □ 

Proof of Theorem 2.2 (Sufficiency) Firstly we consider the case where 1 < q < p < 2. Since 
EX = 0, we see that 



n > 1 



so that, by Lemmas 3.3 and 3.4, (2.2) ensures (1.1) which implies (2.1). 

Secondly we consider the case where 1 < p < q. Since B is of stable type p, the Maurey-Pisicr [16] 
theorem asserts that it is also of stable type p + (5 for some < 8 < q — p. By Remark 1.2, (2.1) holds 
if we can show that 

°° 1 /US' II X^"'"'' 

XeSLLN{p,p + 5)- i.e., ^-f^j < oo a.s. (3.18) 

n=l ^ ' 

Since EX = 0, we have that 

n n 

Sn = ^XkI{\\Xk\\P <n} + ^XkI{\\Xkr > n} 



(3.19) 



k=l k=l 

n 

= {Un-EUn)-nEXI{\\X\\P >n} + J2^kI{\\Xk\\^ >n}, n>l. 

k=l 

It is easy to see that 

\ max ||Xfc||P>?7. i.o.{n)\ = {\\Xn\\P > n i.o.(n)}. 

\^l<k<n J 

Since {Xn, n > 1} is a sequence of independent copies of B-valued random variable X with E||X||*' < oo, 
it follows from the Borel-Cantelli lemma that 

P(||X„||*' > n i.o.(n)) = 

and hence 

P ( max \\Xk\\P > n i.o.(n) ) = 0, (3.20) 

\l<k<n J 

which ensures that 

^l( IIEL.W.r>„>|i y^^^_^ 

n=l ^ ' 

Note that 1 < p < 2 and E\\X\\p < oo imply that 
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Thus, by (3.16) of Lemma 3.5, wc have that 



1 /^||nEX/{||X||P >n}ll^^+^ 



n=l 



1 f\\nEXI{\\X\\P > n}||y /||nEXI{||X||P > n 



n=l 

< OO. 

Since B is also of Radcmacher type p + S, we get that 

E \\Un - E?7„f +^ < CianE > n} - EX/{||Xf > n}f+^ 

< Ci4E||X||f+^I{||X||P > n}, n>l. 
Thus, by (3.15) of Lemma 3.5, we have that 

n=l ^ ' n=l 

and hence 

^ 1 f \\U,,-EUJ Y+' ^ 

y - 77 < OO a.s., 

n=l ^ ^ 

which, together with (3.19), (3.21), and (3.22), ensures (3.18). 

Lastly we consider the case where 1 < q = p < 2. Since E||Xp < oo, we have that 

u 

lim — = 0; i.e., lim = 0. 

Hence we can assume, without loss of generality, that Un < n^^^ for all n > 1. Since EX = 0, we have 
that, for n > 1, 

n n n 

Sn = ^Xfc7{||Xfe|| <n4 + ^Xfei-K < \\Xk\\<n^/P} + Y,XkI{\\Xk\\>n^/P} 

k=l k=l k=l 

(3.23) 

n 

= ([/« - EUi'^) + {up - Ei7P) - nEXI{\\Xr > n} + ^XkI {\\Xj,r > n} . 

k=l 

Since (3.20) follows from E||X||*' < oo, we see that 

n=l ^ ' 

Since p> 1 and E||Xp < oo, it follows from (3.16) of Lemma 3.5 that 

^ 1 f \\nEXI{\\X\\" > n}\\ Y ^ ^ (E||A-|| J > nj)^ ^ 

2^n[ n^P J ^P ^'-''^ 

n=l ^ ' n=l 
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Since E||X||^ < oo and B is a Banach space of stable type p G (1, 2), by Remark 3.2, (3.12) holds, which 
ensures that 

oo 



E 

n=l 



1 



p 



n 



n 



i/p 



< oo a.s. 



(3.26) 



Since B is also a Banach space of Rademacher type p, we have that, for all n > 1, 



EWU^-EU^r < Ci5j2EjXkl[un < \\Xk\\ < nVf} -E (x/{«„ < ||X|| < n^p}) 

k=l 

< 2Ci5nE (||X||^'J {< < \\X\\P < n}) 
= 2Ci5n rtdF{\\X\\P < t) 

rn 

< 2Ci5n<P(||X||^' >0 + 2Ci5n / ¥ {\\X\\p > t) dt 

/•n 

< 2Ci5< + 2Ci5n / Fi\\X\\P>t)dt. 

Now (3.14) holds by Lemma 3.5. Thus it follows from (3.14) and (2.2) that 

V2 <°°' 

which ensures that 



n=l 



n=l 



< OO a.s. 



(3.27) 



Combining (3.23)-(3.27), we conclude that (2.1) holds for q = p. The proof of the sufficiency half of 
Theorem 2.2 is complete. □ 

Proof of Theorem 2.2 (Necessity) For the case where g 7^ p, by Theorem 1.4, we see that (2.2) 
follows immediately from (2.1). 

We now consider the case where q = p. By Theorem 1.4, (2.1) implies that EX = and E[|X||^ < 00. 
Hence we can assume, without loss of generality, that < n for all n > 1. We thus only need to show 
that (2.1) (with q = p) implies that 

^ n¥{\\X\\P >t)dt 
^-^ n 

n=l 

To see this, let {X', X^; n > 1} be an independent copy of {X, Xn, n > 1}. Let 

n 

Vn={XnI{\\Xn\\^ <n}-X'j{\\X^\\P <n}) and S«=^yfc, n > 1. 

k=l 

Then {Vn, n > 1} is a sequence of independent symmetric B-valued random variables. By the Borel- 
Cantelli lemma, it follows from E||Xp < 00 that 



\XJP > n i.o.(n)) = 0, 
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which ensures that 

n 

= ^XkI {\\Xk\f >k} = 0(1) a.s. as oo 



k=l 

and hence 



— 1 /||5'n^||\^ °^ \\Si^'^\\P 



Note that 



n=l \ / n=l 



<|i5„|| + ||5(,^^||, n>l. 
It thus fohows from (2.1) (with q = p) that 



j:^<ooa.s. (3.29) 



1 " 

n=l 



and hence 

J2 < oo a.s. (3.30) 

n=l 



Let On = l/ri^, n> 1. Then 



.2 

, /(, / ±. iiieii 

oo oo 



?'n = l^afc = l^^<^, n>l 

fe=n fe=n 



and hence 

2 



sup6„||y„||^' < sup - (in^/pY = 2P+^ a.s. 
■n>i ii>i n \ J 



n>\ n>l n 

We thus have that 

Efsup6„||y„||f^ <oo. (3.31) 

Vn>l / 

By Theorem 3.1, we conclude from (3.30) and (3.31) that 

n=l 

that is, 

/ oo II c'{l)||p\ 
\n=l / 

By Lemma 3.6, it foUows from (3.29) and (3.32) that 



that is, 

^^^^ 



n=l 



Since 1 < p < 2, applying (2.5) of Ledoux and Talagrand [9, p. 46], (3.33) ensures that 

/ 9 < °° 

n=l 
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which, together with (3.33), gives 



n=l 

By Lemma 3.7, this is equivalent to 



-2 < (3-34) 

n=l 

Since \\ui^^ - EC/^^^ || <\\Un- EC/nll + Wi^^ - EC/^^^ ||, n > 1 and B is of stable type p where 1< p < 2, 
it follows from Remark 3.2 and (3.34) that 

-2 < (3-35) 

n=l 

By Lemma 3.1 (ii) of Li, Qi, and Rosalsky [10], 

E max \\XkI{ul < ||Xfef < n} - EXJ{< < ||Xf < n}||*' 

l<fe<n 

= E f max \\XkI{ul < \\Xk\\P <n}- EX/{< < < njllV 

\l<k<n J 

< 2P+'^E\\U^^^ -EUP\\P, n > 1. 
It thus follows from (3.35) and E||Xp < oo that 

Emaxi<fe<„ < ||Xfef < n}f 



n=l 



— E||[/f ^ -Ef/PyP E||X||P 



n=l n=l 

< CXD, 

and hence, by Lemma 5.4 of Li, Qi, and Rosalsky [10], noting that P (||X||^ > Un) < n~^, n > 1, we get 
that 

^m\\'n<<mr<n}^^ (3.36) 

n=l 



Using partial integration, one can easily see that 

\\X\\PI {< < \\X\\P <n}- F{\\X\\P > t) 



dt 



P 

< — + nP(||X||P > n), n>l. (3.37) 
n 



Since E||X||?' < oo, we have 



n=l n=l 
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and, by Lemma 3.5, (3.14) holds. We thus see that (3.28) follows from (3.36), (3.37), (3.38), and (3.14) 
thereby completing the proof of the necessity half of Theorem 2.2. □ 

Proof of Theorem 2.3 We only need to consider the case where q> 1 since for the case where q = l, 
Theorem 2.3 is Theorem 2.3 of Li, Qi, and Rosalsky [10]. Note that 



< max \\Xk\\ > n i.o.(n) > = {H-'^nll > n i.o.(n)} 

|_l<fe<n J 

and for p = 1, 

n 

Un = Y.^kI{\\Xk\\<n), n>l. 
k=l 

By the Borel-Cantelli lemma, it thus follows from < oo that 

max \\Xk\\ > n i.o.(n) J = 

l<fc<n J 

and hence 

r {Sn - Un ^ i.o.{n)) = 0, 

which ensures that 

n=l ^ ' 

and by the Mourier [17] SLLN, it follows from (2.4) that 

C/„-„E(X/{||X||<„}) ^ /£, _ ^ X _ ^ ^ ^ ^ ^ 

n^oo n n-^oo \ n I n->oo 77, 



t i < ^ (3.41) 



We now show that 

00 

V 

n \ n 

n=l ^ ' 

Since B is of stable type 1, the Maurey-Pisier [16] theorem asserts that it is also of stable type 1 + 5 
for some < 5 < g — 1 and hence 

E \\Un - nE(X/{||X|| < n})f +^ < CieE < n}) , ra > 1. 

Thus, by (3.15) (with p = 1) of Lemma 3.5, we conclude that 

|C/n-nE(X/{||X|| <n})r 



y^E 

and hence 



n \ n 

n=l 



< OO 



^ n \ n I 

n=l ^ ' 

which, together with (3.40), ensures that (3.41) holds since g > 1 + (5. Note that 

Sn = {Sn - Un) + {Un - nE{XI{\\X\\ < n})) + nE(XJ{||X|| < n}), n > 1. 
We thus see that (2.3) (with q > 1) follows from (3.39), (3.41), and the second half of (2.4) (with q > 1). 
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Conversely, by Theorem 1.4 and the Mourier [17] SLLN, it follows from (2.3) that EX = and 
E||X|| < CO and hence (3.39) and (3.41) (since B is of stable type 1) hold. Note that 

n¥.{XI{\\X\\ < n}) = 5„ - (5„ - Un) - (Un - nE{XI{\\X\\ < n})) , n > 1. 

It thus follows from (2.3), (3.39), and (3.41) that 

^ ||E(XJ{||X||<n})r / ||nE(XJ{||X||<n})|| y 

n=l n=l ^ ' 

and hence (2.4) holds (with g > 1). The proof of Theorem 2.3 is complete. □ 

4 Three Examples 

Li, Qi, and Rosalsky [10] provided three examples (sec, Examples 5.1, 5.2, and 5.3 of Li, Qi, and 
Rosalsky [10]) for illustrating the necessary and sufficient conditions that they obtained for (2.3) for the 
case where q = \. In this section we provide three examples to illustrate our Theorems 1.4, 2.2, and 
2.3. 

Example 4.1. Let 1 < r < p < 2 and let X be a real-valued symmetric random variable such that 
P(X = 0) = 6 and P(|X| > = J ^p+i in^t ^^' * - ^' 



where 5 = 1— r°° r dx. Th< 



en 



P(|X| >t) 3_ as t^oo 

^' ' ' ptPWt 

and hence, for 1 < q < p, 

as t oo. 

We then see that 

roo ( <oo ifp/r <q<p, 

/ Fi/P {\X\i > t) dt < 

° [^=00 ifl<q<p/r. 

It is also easy to check that 

E\X\P ln(l + |X|) = oo and E|X|« = oo for all q > p. 

By Theorem 2.2 and Remark 1.2, for this example, X G SLLN{p,q) if and only if p/r < q < oo. 
However, by Corollary 2.2, (1-1) holds if and only if p/r < q < p. This means that, if (1.1) holds for 
some q = qi > 0, one cannot conclude that (1.1) holds for either < q < qi or q > qi. 

Example 4.2. Let 1 < p < 2 and let X be a real-valued symmetric random variable with density 
function 

f ix) = I I , -I — I I- — ; — r-^Hlxl > 3}, 
■'^ ' |x|P+i(ln|a;|)(lnlnlx|)2 ' ^' 

where < b < oo is such that f{x)dx = 1. Clearly, we have that 

EX = and ElXF < oo. 
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Since 

we see that 

(2bny/P 

Un ~ TTi—, ZTTT as n ^ oo 

(lnn)Vp(lnlnn)2/p 

and hence, for all sufficiently large n, 

/ ¥(\X\P>t)dt = / ¥{\X\>t^/'p\dt 

(Inn) (In Inn)-^ 

~ (Inn) (In Inn) 2 J sbn t 

(Inn) (In Inn)-^ 



(In n) (In In n) 



as n — >■ CX3. 



and so 



TT^^ T =00 



n=3 



n(lnn)(lnlnra) 



^ T- s p x^{\X\P > t)dt 



n 

n=l 



Theorem 2.2 and Remark 1.2, we thus conclude that X ^ SLLN{p,q) for this example for all 
<q<p. 

Let 1 < p < 2 and let n > 1} be a sequence of independent copies of a symmetric real- valued 

random variable X. Then, by either Theorem 2.2 or Theorem 2.4, the following three statements are 
equivalent: 

(i) EX = and E\X\p < oo; 

(ii) X G SLLN{p, q) for some q > p; 

(iii) X e SLLN{p, q) for all q > p. 

However, the following example says that this is not true when p = 1. 

Example 4.3. Let X be a real-valued random variable such that 

1 \ r°° 1 

= = 1 - a and F(X > x) = ^r- — — — — -^rdt, x > 

I- a) ^ Jx t2(lnt)(lnlnt)2 

EX = 0, E\X\ < oo, 

and, for all sufficiently large n, 



Tdt = - 



Inty In Inn 
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Note that 

oo ^ 

Thus for this example, by either Theorem 2.3 or Theorem 2.4, X ^ SLLN{l,q) for all q > 1. 
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